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Abstract: The inverse crime occurs when the same (or very nearly the same) 
theoretical ingredients are employed to synthesize as well as to invert data 
in an inverse problem. This act has been qualified as trivial and therefore to 
be avoided by Colton and Kress ^J. Their judgement is critically examined 
herein. 
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1 Introduction 



Solving inverse problems related to some physical application (e.g., finding 
the constitutive constants of a material from the reflectivity j2]), for a Np- 
dimensional vector p of parameters {pi,pi, ■■■,PNp}, requires matching a the- 
oretical model (parametrized by a vector of variables of the same nature as 
the entries of p) of some observable (reflectivity in the above example) to A^^^ 
measurements of the latter embodied in the data vector d = {di, di, dN^}. 

Often, tests of the exact or approximate theoretical models employed in 
inversion schemes are made with synthetic data. Generating the latter also 
requires a theoretical model, which, mathematically speaking, can be iden- 
tical to, or different from, the one employed in the inversion scheme. In pQ, 
which serves as a reference to many workers in the field of inverse scattering 
problems, the authors coin the expression "inverse crime" to denote the act 
of employing the same model to generate, as well as to invert, synthetic data. 
Moreover, they warn against committing the inverse crime, "in order to avoid 
trivial inversion" and go on to state: "it is crucial that the synthetic data be 
obtained by a forward solver which has no connection to the inverse solver" . 

These assertions raise the following questions: i) what does the term "no 
connection" mean? ii) provided a definition can be provided, what kind of 
reconstructions of the unknown parameters can one obtain when there is " no 
connection" between the forward and inverse solvers? iii) should the inverse 
crime always be avoided? and iv) are inverse crime inversions always trivial? 

These questions are difficult to address when Np and/or Nd are larger 
than one. However, the case Np=Nd=l is interesting in its own right, and 
may furnish insight as to what may occur in inverse problems involving mul- 
tidimensional p and d. 

2 Representations of the forward and inverse 
solvers (predictor and estimator) 

The inverse problem studied in this investigation is to determine from p : = 
Pi G M from d := di & C . What in [Ij is called the "forward solver" 
is here termed the predictor, i.e., it involves predicting the response of a 
physical system with the help of some mathematical model incorporating 
the parameter one wishes to recover. We denote the predictor by ^{<f), 
wherein 99 is a variable, of the same nature as p, which can take on the value 
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p. What in [T is called "inverse solver" is here termed the estimator, i.e., 
it involves estimating the response of some physical system with the help 
of the same (as previously) or another mathematical model incorporating a 
variable usually having the same physical and mathematical attributes as the 
parameter one wishes to recover. We call this E{e), wherein e is the variable 
analogous to (p. Thus, for a single experiment, we synthesize the single piece 
of data hj d = and seek to recover p with the help of the estimator 
E{e), wherein e varies over a certain range, hopefully including p. 

In fact, we do this for a continuum of experiments involving the single 
pieces of data d = ^{p), wherein if varies over the range 

1> ip>0 . (1) 
We therefore expect e to lie in the same range 

1 > e > , (2) 
and expand the predictor and estimator in the following series : 

N M 

^^^''Kv) = J2^nfni^) , E^''\e) = Y.a^Ue) , (3) 

Ti=0 m=0 

(wherein the fm{C) ^I's complex, continuous functions of the real variable ( 
satisfying 1 > ^ > 0). In order to account for the inverse crime in the easiest 
manner, it is most convenient to take 

bm = am ; m = 0, 1,2, ... . (4) 

However, we also want to account for the case in which the predictor and 
estimator are different (i.e., "not connected" in the language of jT]); this is 
done by taking M to be different from N. 

3 The comparison equation for the recovery 
of the parameter from the data 

The usual way to solve the inverse problem is to minimize some functional of 
the discrepancy between the estimator and the predictor. Since, at present. 
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we seek only one parameter, it is easier to just solve the so-called comparison 
equation 

K^^'^\e; if) := E^^'\e) - ^(^^((p) = , (5) 

for e, with the understanding that the reconstruction will be perfect if e turns 
out to be equal to (p. 

Note that this way of handling the inversion is equivalent to the usual 
way involving minimization, since the zeros of K'^'^^'^\e; ip) are identical to 
the values of e for which the discrepancy functional attains its minima. 

Note also that, on account of and (jD), ^^^\ip) can be replaced by 
in ©. 

4 General features of solutions of the com- 
parison equation in the context of the in- 
verse crime 

As stated previously, the inverse crime corresponds to M = A^, so that 

{e; ^) := E'-''^ (e) - (<^) = . (6) 

It may be thought that this equation possesses at least one solution, i.e., the 
correct ("trivial inverse" in the language of jlj) solution 

^ = ^, (7) 

but this is not necessarily so (inspite of what is stated in P), when, for 
example, M = and /o is a constant (i.e., does not depend on its argument)). 

To go deeper into the features of the inverse crime, we must be more 
specific about the functions fm- We make two choices, one of which is abstract 
and the other a feature of a real-life inverse problem. 

The first choice is: 

fmic) = r , (8) 

by means of which we obtain 

M 

K^^''^'\e- ^) = J2 "-(^"^ -Vn=0. (9) 

m=0 
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This generally non-linear comparison equation has at least one solution (i.e., 
the "trivial inverse" e = (f) as long as M > 1. The solution is unique when 
and only if M = 1 (we are excluding the absurd choice oi = 0). Otherwise 
(i.e., M > 2) the polynomial equation (jS)) possesses M roots which are usually 
not degenerate. For instance, when M = 2, the two roots are: 

e = (fi, , e = -(p-ai/a2. (10) 

Since the second root is not generally equal to the "trivial inverse", the in- 
verse crime is not trivial in this case. Of course, this argument and conclusion 
carry over to situations in which higher-order models are employed. 
Consider next the second choice whereby M = 0, oq 7^ 0, and 

/o(C) = exp{-2tkC) , (11) 

with k a real constant and i := y/^. This is the exact model of reflection of 
a plane wave exp{—ikxs) normally-incident on a fiat mirror = ip ; Va;i G 
M , Va;2 € M. For instance, if the boundary condition is of the Dirichlet type 
(corresponding to the case in which the electric field is wholly tangential to 
the boundary and the latter covers a perfectly conducting medium), then 
ao = — 1 With this choice, and the observable being the reflectivity, the 
comparison equation © becomes 

K^^'^\e; if) = ao[exp(-2ife) - exp{~2ikip)] = . (12) 

This is equivalent to the non-linear equation sin[fc(£: — (/?)] = the solutions 
of which are: 

e = (fi + nn/k ; n G Z . (13) 

Once again, we obtain not only the "trivial inverse" e = (p, but a number 
(infinite) of other solutions. The latter betray the fact that, even in the 
context of the inverse crime, the inverse problem of locating the height (p of 
the mirror from one measurement of the reflectivity is an ill-posed problem 
(due to the non-uniqueness of the solutions 0,111 )• This finding is at odds 
with what is written in pj concerning a boundary recovery problem solved 
by committing the inverse crime: "Hence, it is no surprise... that the surface 
dD is recovered pretty well" (here dD is the boundary of the mirror, or in 
particular its location), since, in our example, not only do we recover the 
location of the mirror, but also the locations of other planes on which the 
boundary condition is satisfied (this being a surprise). 



6 



The latter example illustrates another feature of the inverse crime: its 
usefulness. To be more specific, (|13p tells us that we can actually obtain 
the location of the mirror unambiguously from two or more experiments 
conducted for two or more values of k (i.e., for > 2 values of the frequency 
of the incident wave), since the only value of e in (fTSj) that is independent 
of the frequency is the correct value e = (p. This idea has been put to use 
recently in a more complicated shape identification problem 

5 The "no connection" issue 

As stated previously, in the framework of this paper, an estimator that is 
different from the predictor means that M ^ N so that the comparison 
equation is: 

M N 

K'^^'^\e- ^) := J2 (^^fm{e) - <^mfm{^) = . (14) 

m=0 m=0 

The term "no connection" can be understood to mean that M be very differ- 
ent from N, but this may not be necessary for certain ranges of the estimator 
and predictor. 

To begin the discussion, consider again the case M = such that /o is a 
constant (i.e., does not depend on its argument). Then e does not appear in 
(|T^ which means the non-existence of a solution. 

Lest this type of estimator appear to be too extreme, consider the choice 
of fm given in (jH)), and the case in which the estimator is linear and the 
predictor quadratic. Then (fT^ yields 

e = (p + (a2/ai)v5^ • (15) 

What is remarkable about this result is the uniqueness of the solution (due 
to the linearity of the estimator). However, the relative error of the recon- 
struction S = \{e — (f) / (f\ (=0 for the "trivial inverse") is 

6 = \{a2/ar)^\ , (16) 

and this is small only if |(ci2/oi)| and/or are/is small. This shows that it 
may be impossible to obtain a solution, whose relative error lies below some 
prescribed threshold, when employing an estimator (linear in this example) 



7 



that has "no connection" to the predictor (quadratic in this example). A 
similar finding can, of course, be obtained for other unconnected estima- 
tor/predictor pairs. In other words, if one wants to recover the unknown 
parameter very accurately he shouldn't follow the recommendation p of 
choosing an estimator that has "no connection" with the predictor. In gen- 
eral, the larger is the functional difference between the estimator and the 
predictor, the larger is the relative error of the inversion jH]. 

6 Discussion 

Let us return to the four questions raised in section 1. Concerning the mean- 
ing of the term "no connection", we proposed that this be materialized by 
a difference in the number of terms in a power series representation of the 
predictor and estimator. Of course, we could have proposed more radical 
differences, but it is hardly conceivable that they would yield a result that is 
better than the one ((HSI)) of section 5. 

The response to the question concerning the kind of reconstructions one 
can obtain when there is "no connection" between the predictor and esti- 
mator is provided eloquently by (fT^ . i.e., in such a case one can obtain 
reconstructions of p that have "no connection" to the actual p. 

The reponse to the question as to whether the inverse crime should always 
be avoided is, negative, since committing this crime can, at the very least, 
reveal the non-uniqueness of the inverse problem. It could be argued that 
this non-uniqueness (certainly a negative feature) is somehow induced by the 
inverse crime, with the implication that abolishing this crime would make the 
solution unique. However, non-uniqueness is neither a necessary, nor specific, 
feature of the inverse crime as is illustrated by the fact that by taking a linear 
estimator and linear predictor one obtains one and only one solution, the so- 
called "trivial solution" e = (p. 

A last comment on this question: it is rather strange to employ the 
disparaging term "trivial" to qualify what is, after all, the very objective of 
solving an inverse problem, i.e., reconstructing as accurately as possible the 
unknown parameters (in our case, obtaining e as close as possible to (p). 

The response to the question as to whether inverse crime solutions are 
always trivial, is provided by (fTUj) for the abstract example, and by (fT^ for 
the concrete example, i.e., not only does committing the inverse crime lead 
to the "trivial solution" £ = but also to one or more other solutions 
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whose existence might be observed in a full-blown numerical procedure, but 
not necessarily revealed by a non-inverse- crime analysis. 

The material provided herein, based essentially on three examples, does 
not pretend to be universal. Obtaining one parameter from one piece of 
data does not resume the way things are usually done in the field of inverse 
problem solving. In fact, often one relies on more data than the number of un- 
known parameters, but even this does not always resolve the non-uniqueness 
issue |7|. This is particularly so in an abstract setting (as for the first ex- 
ample in section 4), but, as we have shown, when there are physical reasons 
why a solution should be invariant to the change in some physical parameter 
(e.g., the location of a mirror should be invariant to the frequency of the 
probe radiation) then two measurements (at different frequencies) are cer- 
tainly better than one measurement to distinguish the correct solution from 
false solutions, provided, of course that the error (experimental, or with re- 
spect to the estimator when employing synthetic data) of the two (or more) 
pieces of data are of the same order. 

When, as is usually the case, one wishes to recover more than one pa- 
rameter from more than one pieces of data, then a mathematical analysis of 
the type proposed herein rapidly becomes very complicated, but would, if 
it were carried out, certainly provide a useful contribution to the field, al- 
though it can hardly be expected that the last sentence of section 5 would be 
contradicted in situations more complicated than the ones analyzed herein. 

A final question, not raised in section 1, is whether there is a risk (if 
such is one's concern) of committing the inverse crime in practical problems, 
this meaning problems appealing to real (as opposed to synthetic) data. We 
see no such risk since the predictor for real data is unknown. The worst (if 
one apprehends punishment for committing a crime, but the best otherwise) 
that can happen is that the experiment be done very properly and the model 
employed in the estimator very nearly mimic the physics of the experiment, 
in which case the chances are great that one will accurately recover the 
sought-for parameters of the object under study. But, as we have shown 
herein, one might also recover artifacts jH] that will have to be eliminated by 
some sort of strategy such as performing other well-chosen experiments (this 
choice could be facilitated by an analysis relying on data synthesized by a 
predictor that is functionally equivalent to the estimator, i.e., by committing 
the inverse crime) or incorporating a priori information about the object at 
the comparison stage (this is usually what is done in the procedure called 
regularization |U]). 
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